DECODING LOW DENSITY PARITY CHECK CODES 
Field of the Invention 

The present invention relates to a method and apparatus for decoding Low Density Parity 
Check (LDPC) codes. 

5 

Background of the Invention 

In many communication systems, including both wired and wireless transmission 
systems, there are strict limitations on transmit signal bandwidth. Such limitations impose a 
demand for signal modulation with a number of levels greater than two. Many conventional 
10 systems employ Trellis-coded modulation (TCM) in such applications. 

There is a growing demand for communication systems, including both wired and 
emerging wireless transmission systems, that require modulation to be accomplished with a 
number of levels greater than two, mainly due to strict limitations on transmit signal bandwidth. 
15 Trellis-coded modulation (TCM) is an example of a conventional modulation scheme for such 
applications. However, a problem associated with TCM is that it is unsuitable for iterative 
decoding. Therefore, further improvements in signal quality at an acceptable complexity are 
difficult to achieve. 

20 " A turbo TCM scheme with low decoding complexity." Catena Networks Inc.. Temporary 

Document BI-090. ITU-T Study Group 15. Question 4. Goa. India. 23-27 Oct. 2000. "Proposal 
of decision ma king for turbo coding and report of performance evaluation of proposed 
TTCMfPCCQ with R-S code and without R-S code." Mitsubishi Electric Corp.. Temporary 
Document BI-003. ITU-T Study Group 15. Goa. India. 23-27 Oct. 2000. and "Results of the 

25 requirements requested in the coding ad hoc report." Vocal Technologies Inc.. Temporary 
Document HC-073. ITU-T Study Group 15. Question 4. Huntsville. Canada. 31 July - 4 August 
2000* describe turbo-coding schemes for multilevel ADSL and VDSL transmission. These 
turbo-coding techniques involve encoding of the information bits by parallel concatenation of 
convolutional encoders in recursive systematic form and iterative decoding by one of several 

30 possible turbo-decoding techniques. "Block product turbo codes for G.dmt.bis and G.lite.bis." 
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Globespan Inc„ Temporary Document BA-063, ITU-T Study Group 15, Question 4, Antwerp, 
Belgium, 19-23 June 2000 describes the application of block product codes using component 
Bose-Chaudhuri-Hoequenghem (BCH) codes and their soft iterative decoding based on the 
Chase algorithm. These techniques offer some performance enhancements over Trellis coding at 
5 the expense of incurring additional complexity. 

Another coding technique uses Low Density Parity Check (LDPC) block codes. As indicated in 
R. G. Gallager, "Low-density parity-check codes," IRE Trans. Info. Theory, vol. IT-8, pp. 21-28, 
Jan. 1962 , D. J. C. MacKav and R. M. Neal "Near Shannon limit performance of low density 
parity check codes. Electron. Lett., vol. 32, no. 18, pp. 1645-1646, Aug. 1996 , D. J. C. MacKav, 

10 "Good error-correcting codes based on very sparse matrices," IEEE Trans, on Inform. Theory. 
vol. 45, No. 2, pp. 399-431, Mar. 1999, and FOSSOR1ER, M.P.C., MMALJEVIC, M., and 
IMAI, H.: "Reduced complexity iterative decoding of low density parity check codes based on 
belief propagation", IEEE Trans. Commun., 1999, 47, (5), pp. 673-680 , coded modulation using 
LDPC codes has to date focussed on applications requiring binary modulation such as wireless 

1 5 systems or digital magnetic recording. 

K. R. Narayanan and J. Li, "Bandwidth efficient low density parity check coding using 
multilevel coding and iterative multistage decoding/ 9 Proc. Int. Svmp. on Turbo-Codes. Brest. 
France, pp. 165-168, Sept. 2000 describes a multilevel coding technique based on binary LDPC 

20 block codes. This technique uses LDPC codes for bit-interleaved modulation or for multilevel 
coding with iterative multi-stage decoding. For bit-interleaved LDPC modulation according to 
this technique, all the bits used to select a multilevel symbol are LDPC code bits. For multilevel 
coding, several LDPC codes are used as component codes in a multilevel scheme. This technique 
has the drawback of requiring more than one LDPC encoder/decoder, leading to substantial 

25 implementation complexity especially for long codes and/or large constellation sizes. 

"Low density parity check coded modulation for ADSL." Aware Lie. Temporary 
Document BI-081, ITU-T Study Group 15, Question 4, Goa, India, 23-27 October 2000 also 
describes a multilevel coding technique based on binary LDPC block codes. This technique is 
30 similar to TCM, except that LDPC coding is employed instead of convolutional coding. In 
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particular, set partitioning follows the same principle as that used in TCM. This technique has the 
drawback of requiring an additional Bose-Chaudhuri-Hoeguenghem (BCH) code which adds to 
system complexity. Also, set partitioning, as required in TCM and similar schemes, leads to poor 
performance for soft-decision based decoding techniques. 

LDPC codes can be decoded via the sum-product algorithm (SPA). The SPA is described 
in the aforementioned reference D. J. C MacKav, "Good error-correcting codes based on very 
sparse matrices;' IEEE Trans, on Inform. Theory, vol. 45, No. 2, pp. 399-43 L Mar. 1999 . The 
SPA operates on a bipartite graph associated with a given sparse parity check matrix H having M 
rows and N columns. This graph has two types of nodes: N symbol nodes corresponding to each 
bit in a code word x, and M check nodes corresponding to the parity checks pc m (x), 1 < m < M , 
represented by the rows of the matrix H. Each symbol node is connected to the check nodes it 
participates in, and each check node is connected to the symbol nodes it checks. The SPA 
operates by passing messages between symbol nodes and check nodes. The messages themselves 
can be a posterioiri probabilities (APP) or log likelihood ratios (LLRs). Typical message parsing 
schedules alternately compute updates of all symbol nodes and of all check nodes. 

The computational complexity of the SPA is governed by the check node updates. In the 
probability domain, such computation involves the summation of product terms each involving a 
plurality of probabilities. In the log domain, the check node updates require computation of the 
inverse hyperbolic tangent of a product of hyperbolic tangent functions of LLRs. Mackay 
demonstrated via computational simulations that there is a loss in performance of approximately 
0.2dB associated with such conventional techniques. This performance loss can be substantial in 
terms of block and symbol error rates because of the steepness of the error curves of LDPC 
codes. A decoding algorithm having a substantially reduced complexity but without incurring a 
loss in performance would be clearly desirable. 
Summary of the Invention 

In accordance with the present invention, there is now provided a method for decoding 
Low Density Parity Check (LDPC) codes, the method comprising: executing a sum product 
algorithm to recover a set of information bits from an LDPC code represented as a bipartite graph 
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of symbol nodes and check nodes, the sum product algorithm being responsive to input log 
likelihood ratios associated with the symbol nodes; characterized in that the method comprises: 
updating the check nodes of the sum product algorithm; the updating of the check nodes 
comprising generating a set of forward difference metrics and a set of backward difference 
5 metrics in dependence on the ratios of logarithmic probabilities each associated with a 
corresponding symbol node of the LDPC code, updating each metric in the set of forward 
difference metrics in dependence on the absolute value of the log likelihood ratio associated with 
the symbol node and the absolute value of the previous metric in the set, updating each metric in 
the set of backward difference metrics in dependence on the absolute value of the log likelihood 
10 ratio associated with the symbol node and the absolute value of the previous metric in the set, 
and generating log likelihood ratios to be propagated back to each symbol node in dependence on 
the updated sets of forward and backward difference metrics. 

The updating of the sets of forward and backward metrics preferably further comprises 
1 5 adding a correction factor to each updated difference metrics. 

The present invention also extends to apparatus for decoding Low Density Parity Check 
(LDPC) codes comprising recovery logic for performing the steps of a method herein before 
described. The present invention further extends to a data storage system comprising a data 
20 storage medium, a transducer for converting physical variations in the data storage medium into 
electrical signals, and apparatus for decoding Low Density Parity Check (LDPC) codes as herein 
before described for recovering recorded data from the electrical signals generated by the 
transducer. 

25 Furthermore, the present invention extends to a communications device comprising an 

information source for generating a set of information bits and apparatus for decoding Low 
Density Parity Check (LDPC) codes as herein before described for recovering information bits 
from the received symbols. 

30 
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Brief Description of the Drawings 

Preferred embodiments of the present invention will now be described, by way of 
example only, with reference to the accompanying drawings, in which: 

5 Figure 1 is a block diagram of a communication system; 

Figure 2 is a block diagram of a transmitter of the communication system; 

Figure 3 is a block diagram of a receiver of the communication system; 

10 

Figure 4 is a graph of symbol-error probability versus SNR nor n for a 64-QAM communication 
system; 

Figure 5 is a graph of symbol-error probability versus SNR norn for a 4096-QAM communication 
15 system; 

Figure 6 is a graph demonstrating the performance of an example of an LLR-SPA for an additive 
white Gaussian noise channel; 

20 Figure 7 is a flow diagram of a method for decoding LDPC codes; 

Figure 8 is a flow diagram of an example of an updating step of the method shown in Figure 7; 

Figure 9 is a flow diagram of another example of an updating step of the method shown in Figure 
25 7; 

Figure 10 is a block diagram of a data storage system; and, 

Figure 1 1 is a block diagram of a data recovery apparatus of the data storage system. 

30 
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Detailed Description of the Preferred Embodiment 

Referring first to Figure 1, a preferred embodiment of the present invention comprises a 
transmitter 10 connected to a receiver 20 via a communication channel 30. In operation, the 
transmitter 10 receives a sequence of information bits 50 from an information source 40. The 
5 transmitter converts the information bits 50 into multilevel symbols 60 for transmission to the 
receiver via the communication channel 30. The multilevel symbols 60 are of a complex form 
having a real part and an imaginary part. The communication channel 30 introduces noise to the 
multilevel symbols 100 to produce a flow of noisy multilevel symbols 70 into the receiver 20. 
The receiver then serially recovers the information bits from the received symbols 70. The 
10 recovered information bits 80 are then supplied to a recipient system (not shown). 

Referring now to Figure 2, the transmitter 10 comprises a divider 100, a block encoder 
1 10 and a symbol mapper 120. In operation, at each modulation instant, the divider 100 divides a 
set of information 50 bits from the information source 40 to be communicated to the receiver 20 
into a first group and a second group. The block encoder 1 10 encodes the first group to generate 
a block code. The symbol mapper 120 connected to the divider and the block encoder for 
selecting a subset of symbols in a constellation of symbols in dependence on the block code 
according to a Gray-coded mapping function and for selecting a symbol within the subset in 
dependence on the second group according to a Gray-coded mapping function. Multilevel 
symbols 60 thus generated by the symbol mapper 120 are communicated to the receiver 20 via 
the communication channel 30. The divider 100 may implemented by a shift register or similar 
logical function. 

With reference to Figure 3, the receiver 20 comprises a multilevel decoder 140 and a soft 
25 demapper 130. In operation, the noisy multilevel symbols 70 are soft demapping by the soft 
demapper 130 to provide soft information on individual code bits in the form of a posteriori 
probabilities 150. The probabilities 150 are employed at the multilevel decoder 140 to carry out 
an LDPC decoding procedure comprising a Sum-Product Algorithm (SPA) for recovering the 
information bits from the received symbols 70. The recovered information bits 90 are then 
30 supplied to a recipient system. 
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Referring back to Figure 1, it will be appreciated that the transmitter 10 and receiver 20 
may be implemented by hardwired logic, by a general purpose processor or dedicated digital 
signal processor programmed with computer program code, or by hardwired logic and computer 
program code in combination. In will also be appreciated that the functions of transmitter 10 and 
receiver 20 may be integrated in a unitary device 160 such as an application specific integrated 
circuit (ASIC) transceiver device. 

When the symbol constellation employed in the symbol mapper 120 is a square QAM 
constellation (i.e., b is even), and provided that the in-phase and quadrature components of the 
noise at the input of the soft demapper 130 are independent, soft demapping can be achieved 
independently for the real and imaginary parts of the complex symbols received. The 
computational complexity of soft demapping is substantially reduced in comparison with joint 
demapping of real and imaginary signals jointly. Square QAM constellations will therefore be 
considered for the purposes of this explanation. However, extensions to cover other types and 
shapes of constellations can easily be derived. It will thus suffice to describe multilevel LDPC 
encoding and decoding for L-ary PAM (L = 2 b ) with the symbol alphabet 

A - {Aq - -(L- l),Aj = -(L - 3), ...,Az/ ( 2-i = ~hAm = +1, ...,A^ = +(L- 1)}, (1) 

Each symbol in the set A is labeled with a binary b-tuple (x^_i,x^ 2 , ...,xi,xo). The b 0 least 
significant bits (LSBs) (^ r i,x w „..,xi,i 0 ) label subsets of the set A. The subsets 
A/, 1 = 0, 1,...,2^ - lare obtained by partitioning A so as to maximize the minimum Euclidean 
distance between the symbols within each subset. The b u =b-b c most significant bits (MSBs) 
{x b -\iXb-z, x b - bu+ i ,Xb- bu ) label the symbols within a subset. Furthermore, the Z> c LSBs and b u 
MSBs each follow a Gray coding rule. Table 1 below gives an example of symbol labeling and 
mapping for the case L = 16. Note that the symbol mapping obtained by this approach is different 
from the one used in conventional trellis-coded modulation. A description of conventional 
trellis-coded modulation is provided in G. Ungerboeck, "Channel coding with multilevel/phase 
signals," IEEE Trans, on Information Theory, Vol. IT-28, No. L pp. 55-67, Jan. 1982 . 
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Table 1 : Example of symbol labeling for the case L = 16, with b u = 2 and b r = 2. 

With the above labeling, an L-ary symbol is used to convey b c LDPC code bits and b u 
uncoded information bits. If coding is achieved with a binary (N 9 K) LDPC code with K being the 
information block length and N being the code length, then this mapping technique results in a 
spectral efficiency of 

f] = §b c + fr w bits/s/Hz (2) 

Decoding of the LDPC-coded signals is achieved in two steps: in the first step, LDPC 
decoding is performed for the sequence of least significant b c bits and in the second step the 
sequence of b u uncoded bits is estimated. 

Denoting by y the received real signal (corresponding, in general, to the real or imaginary 
part of the received complex signal): 



y-A + n 
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(3) 



o 

With A G A and n an AWGN sample with variance <j„, the a posteriori probability 
(APP) that bit x;^A = 0, 1 Z? c — 1, is zero (alternately one) is computed as: 

5 Pr(^ = 0 | y) = , (4) 

o 

Where the summation in the numerator is taken over all symbols Aj G A for which xi — 0 
. Iterative LDPC decoding is achieved by the sum-product algorithm (SPA) using the above APPs. 

10 In the second decoding step, the b u MSBs are estimated for each received signal by first 

determining a subset A; based on the recovered LDPC code bits and then making a minimum 
Euclidean distance symbol-decision within this subset. This second decoding step therefore 
involves a relatively low implementation complexity. 

15 To illustrate the performance that can be achieved with the multilevel modulation 

technique herein before described transmission is considered over an AWGN channel using 
64-QAM and 4096-QAM. The results are presented in terms of symbol-error rate versus the 
normalized signal-to-noise ratio (SNR nor m) defined as 

20 SNRnorm = 2^-1 N 0 ( 5 ) 

where Et/N 0 is the ratio of energy-per-bit to noise-power-spectral-density. The (1998,1777) code 
used in the simulations is due to MacKay. 

25 The graph of Figure 4 is based on 64-QAM (b = 3 along each dimension) and shows 

performance for the cases where b u = 0 (no uncoded bits), b u = 1 (2 uncoded bits per 2D symbol), 
and b u - 2 (4 uncoded bits per 2D symbol). 
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Figure 5 shows the effect of introducing uncoded bits for 4096-QAM {b = 12 along each 
dimension) by plotting system performance with 0, 2, 4, 6, 8, and 10 uncoded bits per 2D symbol 
(b u = 0, 1, 2, 3, 4, and 5, respectively). 

Figures 4 and 5 demonstrate that it is generally sufficient to encode two LSBs only to 
achieve acceptable performance. 

Decoder complexity can be reduced in various ways. For example, not all the L terms need to 
be included in the sum appearing in the denominator of equation (4): if for a received signal y the 
closest L' < L nominal levels are determined the summation can be modified to include these L' 
levels only. The resulting loss in performance is usually very small. A similar approach can be 
taken for the numerator term. Furthermore, messages passed between the nodes in the SPA need 
not be a posteriori probabilities but can be likelihood or log-likelihood ratios. Various 
simplifications of the SPA can be adopted for different implementations depending on specific 
applications. 

The multilevel techniques herein before described are suitable for use in multicarrier 
modulation systems. Examples of such systems include discrete multitone modulation systems 
and filtered multitone modulation systems such as ADSL, ADSL lite and VDSL systems. In 
multicarrier modulation, as each carrier adapts the spectral efficiency of its transmission to the 
channel characteristics, the employed multilevel symbol constellation can vary from one carrier 
to the next. Coding is not performed separately for each sub channel but rather "across" sub 
channels. Therefore, the provision of uncoded bits allows multilevel coding to be achieved in a 
very flexible way because different constellation sizes can be accommodated efficiently. 

As mentioned earlier, LDPC codes can be decoded at the receiver 20 via the sum-product 

algorithm (SPA). The SPA is described in the aforementioned reference D. J. C. MacKav, "Good 

error-correcting codes based on very sparse matrices/' IEEE Trans, on Inform. Theory, vol. 45. 

No. 2. pp. 399-431. Mar. 1999 . The SPA operates on a bipartite graph associated with a given 

sparse parity check matrix H having M rows and N columns. This graph has two types of nodes: 

N symbol nodes corresponding to each bit in a code word x, and M check nodes corresponding to 
CH920000088US1 10 



the parity checks pc m (x), 1 < m < M , represented by the rows of the matrix H. Each symbol node 
is connected to the check nodes it participates in, and each check node is connected to the symbol 
nodes it checks. The SPA operates by passing messages between symbol nodes and check nodes. 
The messages themselves can be a posterioiri probabilities (APP) or log likelihood ratios 
(LLRs). Typical message parsing schedules alternately compute updates of all symbol nodes and 
of all check nodes. 

The computational complexity of the SPA is governed by the check node updates. In the 
probability domain, such computation involves the summation of the product terms each 
involving a plurality of probabilities. In the log domain, the check node updates require 
computation of the inverse hyperbolic tangent of a product of hyperbolic tangent functions of 
LLRs. Mackay demonstrated via computational simulations that there is a loss in performance of 
approximately 0.2dB associated with such conventional techniques. This performance loss can be 
substantial in terms of block and symbol error rates because of the steepness of the error curves 
of LDPC codes. An SPA having a substantially reduced complexity but without incurring a loss 
in performance would be clearly desirable.. 

In a preferred embodiment of the present invention, an approximate check node update is 
based on a difference-metric approach on a two state trellis. This approach employs a dual max.. 
approximation. The aforementioned Fossorier reference describes an example of a dual max.. 
approximation. The approach can be thought of as similar to a Viterbi algorithm on a two state 
parity check trellis. The approach uses the difference of state metrics, i.e., the difference of logs, 
which is the LLR of the probabilities. The approach is recursive and requires one sign bit 
manipulation and one comparison at a time. This greatly simplifies computational 
implementation and facilitates parallel recursive operation in a general purpose Digital Signal 
Processor (DSP) environment, or in an application specific integrated circuit (ASIC) or similar 
custom logic design. 

In a particularly preferred embodiment of the present invention, the performance of the 
algorithm is improved by introduction of a correction factor. The correction factor involves the 
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addition of a constant at every recursive step. The added constant can be viewed as a fixed offset 
with the appropriate polarity. The addition does not significantly increase computational 
complexity. It is found that the correction factor brings the performance of the algorithm to 
within 0.05dB of the performance of the full SPA. 

5 

In a preferred embodiment of the present invention to be described shortly, there is 
provided a soft input/output detection method for decoding LDPC codes by exchanging 
reliability information between the soft demapper 130 and the multilevel decoder 140 in an 
iterative fashion. This decoding method advantageously delivers similar performance to that of 

10 full SPA, but with considerably reduced complexity. The encoded data is demapped into soft bits 
prior to LDPC decoding. LDPC codes can be decoded in an iterative fashion via a complex soft 
input/output algorithm in a manner which is computationally simpler than that conventionally 
employed for decoding turbo codes. Also, as mentioned earlier, LDPC codes exhibit 
asymptotically an excellent performance without "error floors". Further, LDPC codes offer a 

1 5 range of tradeoffs between performance and decoding complexity. 

Following the notation employed in the aforementioned Mackay and Fossosier 
references, let N(m) = {n : H m ^ n = 1 } be the set of bits that participate in check m 9 and let 
M{n)-{m:H m , n - 1} be the set of checks in which bit n participates. The exclusion of an 
20 element n from N(m) or rafrom M(n) is denoted by N(m)\n or M{n)\m, respectively, and H T is 
the transpose of H. Finally, let y= [ji, ...,y^v] be the received sequence that corresponds to the 

transmitted codeword x = [xi,...,x^]. The inputs of the SPA consist of LLRs 
\n(P(x n = l\y n )/P(x n = 0\y n )) or, equivalently, of APPs P(x n = l\y n ) and P(x n = 0\y n ), which 
are determined by the channel statistics. Operation of the SPA then proceeds in the following 
25 steps: 

Initialization: q m , n {x) = P{x n = x \ y n ) for x = 0, 1 . 

Step 1 (check-node update): For each m and n e N(m) 7 and for x = 0, 1 , compute 

30 
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r m , n (x) = S P(pc m (x) = 0 | x„ = x, : n' e N(m)\n}) U q m9 n<(x n >\ 

{x n i:n'eN(m)\n} n'eN(m)\n 

where the conditional probability in the summation is an indicator function that indicates 
whether the ra-th check-sum is satisfied given the hypothesized values for x n and {x n /} . 

5 

Step 2 (symbol-node update): For each rc, and m e M(n) , and for x = 0, 1 , update 

#m,»(*)=/W^(*n=*l)>n) II r m ', rt (x), 

m'eM(«)W 

10 where the constant is chosen such that q m/l (0) + m,«(l) = 1 . 

For each and for x = 0, 1 , update the "pseudoposterior probabilities" g n (.) as 

^(x)=^ w P(x„=x|y„) n r min (x), (6) 

15 

where the constant fi n is chosen such that q n (0) + q n {\) = 1 . 

Step 5: (a) Quantize x= [x h ...,x N ] such that x n = 1 if ^(1) > 0.5, and 
x n = 0if #„(1)<0.5. 

20 

(b) If x/7 r = 0, then stop and x is the decoder output; otherwise go to Step 1. 

(c) Declare a failure if the algorithm does not halt within some maximum 
number of iterations. 

25 

In a preferred embodiment of the present invention, LLRs are employed as messages in 
place of APPs. This permits replacement of the multiplications in Step 2 of the SPA with 
additions. Step 3 can also be easily adapted for LLRs. Advantageously, LLRs can also be 
efficiently used in Step 1 without converting between LLRs and APPs. 
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Simplified Sum-Product Step Using Log-Likelihood Ratios: 

In general, each check-sum pc m (x) can be viewed as a single-parity check code on the 
k= |N(ra)| symbols it checks. The node messages r m>n (x) of Step 1 can be regarded as extrinsic 
5 information for x n given the statistics q m A-)> These messages can be computed by the 
forward-backward algorithm proposed by Mackay on the two-state trellis of the single-parity 
check code as follows (where © denotes addition modulo 2): 

initialization of state metrics: a<)(0) = 1, ao(l) = 0 ; /?*(0) = 1, = 0 ; 
10 forward recursion: For i=l,...,]fc-l and jc = 0, 1 

afc) = om (0)q mtt (x) + aM(l)fc(^ © 1) ; (7) 
backward recursion: For i = (k - 1), . . . , 1 and jc = 0, 1 

15 A(0) = fi M (0 Wi to +fciOWi(« © i) ; 

combining recursion: For i = 1 , . . . , k and x - 0, 1 

r m ,i(X) = a,_i(0)#(x) + a M (l)j5f(jc © 1) . 

20 In the LLR domain, let 5A t = In J§£ and <5£, = In . Note that the LLRs <5A,- and 

can be viewed as the forward and backward difference metrics in the log domain. The application 
of a difference-metric approach to the dual-max detector for partial-response class IV channels is 
described in OLCER, S.. and UNGERBOECK, G.: 4 Reed-Muller coding for partial response 
channels 9 . 1993 IEEE Int. Svmp. on Information Theory, San Antonio, TX (IEEE. Piscatawav. 

25 1992), p. 243 . Consider the two-state parity-check trellis using the difference of state metrics, 
i.e., the difference of logarithms, which is merely the LLR of the probabilities. Consider also the 
following LLRs: A m j=Mn-^^ and A m j = \n^^. Using the above definitions, the standard 
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approximation In Zexpo; » maxa/ and the dual -max rule described in VITERBL A. J.: 'An 

intuitive justification and a simplified implementation of the MAP decoder for convolutional 
codes', IEEE J, Sel. Areas Commun., 1998, 16, (2), pp. 260-264, the forward recursion (7) can 
be rewritten as 

5 

* A i fln(QW^i-i(i)U 0 ) 



= ln{exp(^) 4- exp(<SA,_i)} - ln{l + exp(/L,< +Mm)} (8) 
10 « max{/i m j, Mm} - max{0, A w ,,: +<5Am } (9) 

_ -Sgn(&4.M M/n,i if |<5Am| > PU/| 

-sgn(X m ,j)SA m otherwise, 



where sgn(.) is the sign function. 

15 

The backward and the combining recursions can be reformulated in a similar way, which 
results in the following LLR version of the forward-backward algorithm: 



initialization: SAo = go and SBk = oo 

20 

forward recursion: For i = 2 . . . k - 1 



-sgn(X m9 i)dAi-\ otherwise 



25 backward recursion: For i = k - 1 ... 1 



= r -sgn(^5 /+ i )l mJ+ i if |(55 /+ i | > |2 m , /+1 1 
-sgn(A TO ,i+]>5firi-i otherwise 
CH920000088US1 15 



combining recursion For i = 1 . . . k 

-*#L(dA^y5Bi if \SA^\>\5Bi\ 
1 1 -sgn(SBi)dAi-i otherwise V } 

5 

Correction Factor for the Dual-Max Approximation: 

The simplified SPA that results from using Equations (10) to (12) for the check node 
updates will be called the LLR-SPA because it operates entirely in the LLR domain. The 
LLR-SPA has a slightly lower performance than the full SPA. Following the aforementioned 
10 Viterbi reference, together with GROSS, W. J., and GULAK, P. G.: 'Simplified MAP algorithm 
suitable for implementation of turbo decoders'. Electron. Lett., 1998, 34, (16), pp. 1577-1578 , a 
correction factor can be applied to improve the dual-max approximation from Equations (8) and 
(9). Using the identity 

15 ln{exp(x) + exp(y)} - max{x, y} = ln{ 1 + exp(-|x - y\)} 9 

it can be shown that the approximation error, i.e., (8) minus (9), is given by the bivariate function 



20 f(u,v) = In 1+exp( _| M+v|) , 



where u =SA t -\ and v = A m ,*. In practice, f(u y v) can be approximated by using a single correction 
factor c, i.e., 



c if |m + v|>2|w-v| and |m-v|<2 
25 jf(w, v) » { -c if \u - v| > 2\u + v| and \u + v\ < 2 

0 otherwise . 
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A similar correction factor applies to the approximations in the backward and combining 
recursions. The constant c can be selected to maximize the performance gains in the region of 
interest with respect to bit-error rate or signal-to-noise ratio. Figure 6 shows the performance of 
the LLR-SPA with correction factor c = 0.5 for an additive white Gaussian noise channel using 
5 the same rate- 1/2 LDPC code with Af=504 as in the aforementioned Fossorier reference. For 
comparison, the performance of the full SPA and LLR-SPA is also shown. The number of 
iterations for the two sets of curves shown is at most 10 and 200, respectively. It can be seen that 
LLR-SPA with correction factor performs within less than 0.05 dB of the full SPA. 

10 The present invention is applicable to decoding of LDPC codes in data storage 

applications. In particular, LDPC codes may be employed in parallel with, or as replacements for, 
conventional Reed-Solomon error correction codes in magnetic and optical recording 
applications. Inter-symbol interference is well-known in magnetic recording channels. A 
W magnetic recording channel and encoder in combination can be represented by finite state 
£ 1 5 machine in the form of a serially concatenated system. In a preferred embodiment of the present 

invention to be described shortly, there is provided a soft input/output detection method for 
Hh decoding LDPC codes in a data storage system by exchanging reliability information in an 
O iterative fashion. This decoding method and decoding scheme advantageously delivers similar 
n performance to that of full SPA, but with considerably reduced complexity. 

S 20 

fU With reference now to Figure 7, in a preferred embodiment of the present invention, a 

method for decoding Low Density Parity Check (LDPC) codes comprises, at step 200, executing 
a sum product algorithm to recover a set of information bits from an LDPC code represented as a 
bipartite graph of symbol nodes and check nodes, the sum product algorithm being responsive to 
25 input log likelihood ratios associated with the symbol nodes. The method also comprises, at step 
210, updating the check nodes of the sum product algorithm. 

Referring to Figure 8, the updating step of the check nodes comprises, at step 220, 
generating a set of forward difference metrics and a set of backward difference metrics in 
30 dependence on the ratios of logarithmic probabilities each associated with a corresponding 
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symbol node of the LDPC code. At step 230, each metric in the set of forward difference metrics 
is updated in dependence on the absolute value of the log likelihood ratio associated with the 
symbol node and the absolute value of the previous metric in the set. At step 240, each metric in 
the set of backward difference metrics is updated in dependence on the absolute value of the log 
likelihood ratio associated with the symbol node and the absolute value of the previous metric in 
the set. At step 250, log likelihood ratios to be propagated back to each symbol node are 
generated in dependence on the updated sets of forward and backward difference metrics. 

Referring to Figure 9, a modification to the preferred embodiment of the present 
invention herein before described with reference to Figure 8 further comprises, at step 260, 
adding a correction factor to each updated difference metrics. 

Referring now to Figure 10, an example a data storage system embodying the present 
invention comprises a data storage medium 300, a transducer 310, and data recovery apparatus 
320 connected to the output of the transducer 310. In operation, the transducer 310 converts 
physical variations in the data storage medium 300 into electrical signals. The data recovery 
apparatus 320 executes the method herein before described with reference to Figures 7 and 8 to 
recoverees recorded data from the electrical signals generated by the transducer 310. It will be 
appreciated that the data recovery apparatus 320 may implemented by hardwired logic, by 
computer program code executing on a processor, or by a combination thereof. 

Referring now to Figure 1 1, the data recovery apparatus 320 comprises a soft in/soft out 
decoder 330 connected to an LDPC decoder 340. The transducer 310 and the storage medium 
300 can be notionally lumped together into an equivalent channel 360. In operation, symbols 
370 from the equivalent channel 360 are translated into soft bits 380 by the soft decoder 330. Bit 
decisions 390 are generated by the LDPC decoder 340 based on the soft bits 380. The LDPC 
decoder also generates log likelihood ratios (LLRs) 350. The LLRs 350 are fed back into the soft 
decoder 330. 
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In summary, what has been herein before described by way of example of the present 
invention is a reduced complexity algorithm for Low Density Parity Check. The algorithm 
operates entirely in the Log-Likelihood domain. Check node updates of a sum product algorithm 
are simplified by using a difference metric approach on a two state trellis and by employing a 
dual max. approximation. 
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